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Abstract — In this paper we consider the identification (ID) via 
multiple access channels (MACs). In the general MAC the ID 
capacity region includes the ordinary transmission (TR) capacity 
region. In this paper we discuss the converse coding theorem. 
We estimate two types of error probabilities of identification 
for rates outside capacity region, deriving some function which 
serves as a lower bound of the sum of two error probabilities of 
identification. This function has a property that it tends to zero as 
n — > oo for noisy channels satisfying the strong converse property. 
Using this property, we establish that the transmission capacity 
region is equal to the ID capacity for the MAC satisfying the 
strong converse property. To derive the result we introduce a new 
resolvability problem on the output from the MAC. We further 
develop a new method of converting the direct coding theorem for 
the above MAC resolvability problem into the converse coding 
theorem for the ID via MACs. 

I. Introduction 

In 1989, Ahlswede and Dueck Q],(2], proposed a new 
framework of communication system using noisy channels. 
Their proposed framework called the identification via chan- 
nels (or briefly say the ID channel) has opened a new and 
fertile area in the Shannon theory. After their pioneering work, 
the ID channel coding problem has intensively been studied 
from both theoretical and practical point of view dl3l- lTT3l ). 
Identification via multi-way channels is an interesting problem. 
This problem was studied by J6), J8), lfl4l and 03J. In spite 
of its theoretical interest and practical importance, the number 
of works on this theme seems to be relatively few. 

In this paper we deal with the identification via multiple 
access channels (MACs) for general noisy channels with 
two inputs and one output finite sets and channel transition 
probabilities that may be arbitrary for every block length n. 
Steinberg J8), and the author studied the identification(ID) 
capacity region for general MACs. However, these works have 
a common gap in the proofs of the converse coding theorems. 
This gap was pointed out by Hayashi lfl2l and is not resolved 
yet. 

According to Steinberg J8], by a similar argument to the 
case of single user channels we can show that the ID capacity 
region contains the transmission(TR) capacity region for the 
general MAC. He studied the converse coding theorem by 
using a lemma used to prove the converse coding theorem 
for the ID via single user channels. In this paper we focus 
on our attention to the converse coding theorem and study it 
by an approach different from that of Steinberg. We estimate 



two types of error probabilities of identification for rates 
outside capacity region, deriving some function which serves 
as a lower bound of the sum of two error probabilities of 
identification. This function has a property that it tends to 
zero as n — > oo for noisy channels satisfying the strong 
converse property. Using this property, we establish that the 
transmission capacity region is equal to the ID capacity for 
the MAC satisfying the strong converse property. 

To derive the converse coding theorem for the ID channel 
Han and Verdu (4] introduced an approximation problem of 
output distributions from single user channels. They call this 
problem channel resolvability problem. They first proved a 
direct coding theorem for the channel coding theorem and 
next proved a converse coding theorem for the ID channel 
by converting the direct coding theorem for the channel 
resolvability problem into the converse coding theorem for 
the ID channel. To prove the converse coding theorem for the 
ID via MACs, we formulate a new approximation problem of 
output distributions from MACs. This problem is regard as a 
MAC resolvability problem. A similar resolvability problem 
using MACs was studied by Steinberg IfTTl . Our problem is 
some variant of his problem. We first establish a stronger result 
on the direct coding theorem for this problem by deriving an 
upper bound for the approximation error of channel outputs to 
tend to zero as n goes to infinity. Next, we prove the converse 
coding theorem by converting the direct coding theorem for the 
MAC resolvability problem into the converse coding theorem 
for the ID via MACs. 

II. Identification via Multiple Access Channels 
Let X, y and Z be finite sets. Let V{X n ) and V{y n ) be 
sets of probability distributions on X n and y n , respectively. 
A source X with alphabet X is the sequence {PS ■ P x G 
V (X n )}^ =1 and a source Y with alphabet y is the sequence 
{Pp : Pp G V(y n )}n=v Similarly, a noisy channel W with 
two inputs alphabets X and y and one output alphabet Z is a 
sequence of conditional distributions where 
W n (-\-, •) = { W n (-\x, y) G T(Z n ) } (x , y)eX n x yn. Next, for 
Py- G V(X n ), P y „ G V(y n ) and z G Z n , set 
P xn P Yn W n (z) 

Pxn{x)P Yn {y)W n {z\x,y), (1) 

which becomes a probability distribution on Z n . We de- 
note it by P Xn P Y ~W n = {P X nP Y n W n {z) } ze z-- Set 



Pz™ = Px™ Py" W n and call P z ~ the response of (P X n , P Y „ ) 
through noisy channel W n (or briefly the response of 

An (n, JVi, JVa, £t n , A n ) ID code for is a collection 
{(P^.Py^-, i = l,2,--.,JVi, j = 1,2, ■■■,N 2 } 

such that 

1) Px^£V(X n ),P Y n\ 3 eV(y n ), 

2) Aj c z n , 

3) Pz n \i,j is the response of (P X n u, Py n \j) j 

i<J<W 

5) An y— max P z ™\k.i(Di.j) , K = max A„ « . 

(k,l)^(i,j) l<i<Ni , 

l<j<N 2 

The rate of an (n, N±, N2, /J, n , \ n ) ID code is defined by 

r,, n = -log log iV, ,i = 1,2. 
n 

A rate pair (R\, R2) is said to be (//, A)-achievable ID rate 
pair if there exists an (n,Ni, N2, Mni A„) code such that 

lim sup /i„ < p. , lim sup A„ < A , 

n— ^oo n— foo 

lim inf rj n > Pj , £ = 1, 2 . 

The set of all (/x, A)-achievable ID rate pairs for is denoted 
by Cio(/i, A| W), which we call the (fi, A)-ID capacity region. 

To state results for the identification capacity region, we 
prepare several quantities which are defined based on the 
notion of the information spectrum introduced by Han and 
Verdu 0. 

Definition 1: For n = 1,2, let X n and Y n be an 
arbitrary prescribed independent random variable taking v alues 
in X n and y n , respectively. The probability mass function of 
X n and yn is p Xn ( x ^ x <= x n and P Y n(x), y G y\ 
respectively. A pair of two independent sources (X, Y) with 
alphabet Xxy is the sequence {(Px™, Py») : Px™ G P(Vr n ), 
Pyn G P(^ n )}. A collection of such (X,Y) is denoted by 
Si. Let Z n be an output random variable when we use X n 
and Y n as two inputs of the noisy channel W n . In this case 
the joint probability mass function of (X n ,Y n , Z n ) denoted 
by P X n Y nz*(x,y, z), (x,y,z) G X n x y n x 2" is equal 
to P x ^x)P Yn {y) W n (z\x,y). 

Definition 2: Given a joint distribution Px n Y™z n ( x, y, 
z) = P X n(x)P Y n(y) W n (z\x, y), the information density is 
the function defined on X n x y n : 



called probabilistic limsup/inf in the following. 



p-limsupA„ = inf {a : lim Pr{A„ > a} = 0} , 
p- lim inf A n = sup{a : lim Pr{^4„ < a} = 0} . 

n— >oo n— foo 

The probabilistic limsup/inf in the above definitions is 
considered as an extension of ordinary (deterministic) liminf. 
The operation of limsup/inf has the same properties as those 
of the operation of limsup/inf. For the details see Han and 
Verdu g) and Han 0. 

Definition 4: Set 

I(X; Z\Y) = p- lim inf -i X n Y n Zn (X n ; Z n \Y n ), 
n 

I{Y;Z\X)=j>-]immiUx« Y nz«(Y n ;Z n \X n ), 
n 

1{XY; Z) = p- lim inf -i x -Y~z-{X n Y n ; Z n ). 
n 

Furthermore, set 

C(X,Y\W) = {(Pi,P 2 ) :Ri<L{X;Z\Y), 

R 2 <L(Y;Z\X), 
Ri+R 2 <L{XY;Z)}, 

C(W)= (J C(X,Y\W). 

(X,Y)es I 



i XnynZn (x;z\y) = log 
i x ^Y"Z"{y; z\x) = log 
i X r, Y ^z^{xy; z) = log 



W n (z\x,y) 

P Z n lY n( Z \y) 

W n (z\x,y) 
Pz~\x~{z\x) 
W n (z\x,y) 

P Z n{z) ■ 



Set 



Definition 3: Let {A n }^ =1 be a sequence of arbitrary real- 
valued random variables. We introduce the notion of the so- 



I(X; Z\Y) = p- lim sup - tXn y nZn (X n ; Z n \Y n ), 
n 

7(Y; Z\X) = p- lim sup - lXnynZn {Y n ; Z n \X n ), 
n 

7{XY; Z) = p- lim sup (X n Y n ; Z n ). 

n 

Furthermore, set 

C(X,Y\W) = {(Ri,R 2 ) :Ri<l{X;Z\Y), 

R 2 <7(Y;Z\X), 
Ri+R 2 <1{XY;Z)}, 

C(W)= |J C(X,Y\W). 

Han j9],|[T8l proved that C(W) is equal to the ordinary 
transmission capacity region for general MACs. Han lTT8l 
proved that when C(W) = C(W), the strong converse 
property holds, i.e., the error probability of transmission goes 
to one as n — s- 00 for all transmission rates outside the capacity 
region. 

Identification via multiple access channels was first investi- 
gated by Steinberg J8). His result is the following. 

Theorem A (Steinberg ^S]/J For general noisy channel W, 
we have 

C ro (0,0|W)2£(W). (2) 



The above theorem can be proved by an argument quite 
similar to the case of the identification via single-user chan- 
nels. Steinberg f8j also studied the converse coding theorem. 
In O he established a new lemma useful to prove the converse 
coding theorem of the identification via single-user channels. 
Using this lemma and the capacity formula by Verdu lfl9l . 
he obtained a result on the converse coding theorem for the 
identification via MACs. 

In this paper we study the converse coding theorem for the 
ID via general MACs. Our approach is different from that 
of Steinberg |8|. We derive a function which serves as an 
upper bound of 1 — fj, n — A„ for general MACs. To obtain this 
result we formulate a new resolvability problem for the general 
MAC, that is, an approximation problem of output random 
variables via MACs. We consider this problem and derive an 
upper bound of the approximation error. This upper bound 
is useful for analyzing the error probability of identification 
outside the ID capacity region. 

III. Main Results 

A. Definitions of Functions and their Properties 

We first define several functions to describe our results and 
state their basic properties. 

Definition 5: Let S be an arbitrary subset of X n x y n x Z n 
and ls{x, y, z) be indicator functions which takes value one 
on S and zero outside S. Set 



-n[R 1 -±i x n Ynz n.{X n ;Z n \Y n )] 

Xl s (X n ,Y n ,Z* 



Xl s (X n ,Y n ,Z r ' 

(n,3,S = Cn,3,s(Rl,R2,Pxn , Pyn , W n ) 



{' 



-n[Ri-l t ixnz"(X n ;Z n )] 



+e -«[«2-i»r" Z "(V";Z")] 
+e -r l [fl 1 +J? 2 -ii x , lynzn (X n Y";Z 71 )] | 

xl s (X n ,Y n 7 Z r 

Definition 6: Set 

T 7 = { (x,y,z) g X n x y n x Z n : 

-i X n Y n Z n (x] z\jj) < Rl ~ J , 

n 

or -z X ny„ z „ (y; z\x) < R 2 - 7 , 
n 

or -z X ny„ z „ (xy; z) < i?i + R 2 - 2-f } 



Define three subsets of X n x y n x Z n by 

T ln = { {x,y,z) e X" x y n x Z n : 

(x; z\y) < R x - 7 } , 

n 

T 2n = { (x,y,z) E X n x y n x Z n : 



1 



ix"Y"Z"{y;z\x) < R 2 - 7 } , 



Set 



T 3n = {(x,y,z)eX n xy n xZ n : 

-i x ^Z"(x;z) < Rt -7, 
n 

-i Y "Z"(y;z) <R 2 -j, 

n 

-ix~Y"Z" (xy; z) < R 1 + R 2 - 27 } 
n 



^(R^Px^PyAWn 
= PT{(X n ,Y n ,Z n )£T itl },i = l,2, 

^n\jRl,R 2 ,Px^PYAW n ) 



= Vx{{X n ,Y n ,Z n )iT^}, 
^(R^Px^PyAW") 

= Cn,i,T^ {Ri, Px»,PY<> \W n ),i = 1, 2, 

^^(RuR^Px^PyAW") 

= Cn^T 3 , 1 {Rl,R 2l Px^P Y AW n ), 

n nM {R t ,P x ^P Y AW n ) 

= m { n %(R l7 p x ^p Y Aw n ) 



+3 V /fti 2) li7 (i? 4 , P X n,P Y AW n ),i = 1,2, 
= ^l J (R 1 ,R 2 ,P Xn ,P Y AW n ) 



-^U%l n {Ri,R 2 ,P x ^P Y AW r 



Furthermore, set 



n nn (R 1 ,R 2 ,p x ^p Y Aw r ' 



= mm{n n . ln (R 1 ,Px~,P Y AW n ), 
n n , 2 , 7 (R 2 ,Px»,P Y AW n ), 
^n^{RuR 2 ,Px^P Y AW n )} 

Finally, set 

n n „(Rx,R 2 \W n ) 

sup ^(RuR^Px^PyAW 71 )- 

(P x n,P Y -n) 

ev(x n )xV(y Tl ) 

We can prove that fi„ !7 ( Ri,R 2 , W n ) and f2„ l7 ( i?i 
Px n i Py", W n ) satisfy the following two properties. 
Property 1: 



a) For any < 7 < r, 

= n^iu - 7, Pxn , Py- \w n ), i = 1,2, 

n { n %(R u R 2l P x ^P Yn \W n ) 

= ng^, 7 (iii -7,-^2-7, Px-, Py- |W n ), 
Qi 2 7 (^,Pxn,iVn|W n ) 

n^ 3n (R 1 ,R 2: P x ~ : P Y „\W n ) 
< ^ n ^nio(Ri - 7, i2a - 7, , Py- 

nSU^.^-.iv-lw 71 ) < e-^,i = 1,2, 
n^ n (R u p xn ,p Yn \w n ) 

< e - nT + Q^l T (R i ,P Xn ,P Yn \W n ) 
-n^ in (R tl P Xni P Yn \W n ),t = 1,2, 

Oi 2) 3i7 (i? 1 ,i? 2 ,P X „,Pyn|^") 

-ng^^.iZa.Px-.iV-IW 1 ). 

b) For any 7 > and P x > 0, R 2 > 0, 

< 9£l 1 {R 4 ,P Xn ,P Yn \W n ) < l,i = 1,2, 
< ^ 7 (P 1 ,P 2 ,Px-,Py-.|Ty") < 1. 

Property 2: 

a) For any 7 > and Pi , P 2 > 0, 

73 

o<n ni7 (iJi,.R3 J io< — . 

b) Set 

c'(x,r|w) 

= C(X,r|W) 

U{(Pi,P 2 ) : Pi <J(X;Z),P 2 <T(r ; Z|X)} 
U{(Pi,P 2 ) :P X <I(X;Z\Y),R 2 <7{Y;Z)} 

C'{W)= (J c'(X,r|W). 

(X.Y)es I 

It is obvious that C(W) Q(?(W). If (Pi, P 2 ) ^ c'(W), 
then, there exists a small positive number 70 such that for 

any 7 e [0,70), 

lim n n JR 1 ,R 2 \W n ) =0. 

Proofs of Properties Q] and [2] are quite parallel with those 
of Properties 1 and 2 in lfT3l . Proof of Property 2 part b) is 
given in the appendix. 



B. Statement of Results 

Our main result for the identification via MACs is the 
following. 

Proposition 1: For any (n, N\, N 2 , [i n , A„) code with (j, n + 
A„ < 1, if the rate r^ n = (1/n) log log N{ satisfies 

ri,„ > Pi + ^ + - loglog(3|;r|) 2 , (4) 
n n 

r 2 . n >R 2 + ^ + - loglog(3|y|) 2 , (5) 
n n 

then, for any 7 > 0, the sum /i„ + A„ of two error probabilities 
satisfies the following: 

1-Mn-A„ <a i , 7 (Pi,P 2 |M / "). (6) 

From this proposition, we obtain the following corollary. 
Corollary 1: For any sequence of ID codes {(n, Ni„ N 2 , 
Hn, A„) }^Li satisfying A„ < 1, n = 1, 2, • • •, if 

liminf n <n > R t , i — 1, 2, 

n— >oo 

then, for any S > 0, there exists no = rio(<5) such that for 

n > no, 

1 - Hn - A„ < 0„, 7 (Pi - 5,P 2 - 5|W n ) . (7) 

It immediately follows from Theorem A, Corollary Q] and 
Property 12 part b) that the following strong converse theorem 
holds. 

Theorem 1: For any sequence of ID codes {(n, iV x , N 2 , fi n , 
A«) },T=i satisfying u n + A„ < 1, n = 1, 2, ■ ■ •, if 

liminf n,„ > Ri,i = 1,2, (Pi, P 2 ) £ C'(W), 

n— f 00 

then, 

liminf {/i„ + A„} = 1, 

n— >oo 

which implies that for any /U > 0, A > 0, /i + A < 1 and any 
noisy channel W, 

QiW) C C ID (/i, A|W) C C'(W). 

In particular, if 

C(W)=C(W)=C'(W), 

then, for any ^1 > 0, A > 0, ^1 + A < 1, 

C(W) = C ro (/i, A|W) = C(W) = C'(W). 

Furthermore, p, n + A„ converges to one as n — > 00 at rates 
above the ID capacity. This implies that the strong converse 
property holds with respect to the sum of two types of error 
probabilities. 



C. Results for the Average Error Criterion 

We have so far dealt with the case that the error probabilities 
of identification are measured in the maximum sense. In this 
subsection we consider the following average error criterion: 



JVi N 2 



N X N- 



'J ■ 



i=l j = l 
JVi N 2 



i=i j=i 



(8) 



For < (jl, A < 1, let Ci D ^(/i, X\W) be denoted by the 
identification capacity defined by replacing the maximum error 
probability criterion by the above average error probability 
criterion. Since p, n < fi n and X n < X n , it is obvious that for 
any //, A > 0, 



C m (/i,X\W) CCm+(l*,\\W). 



(9) 



We shall show that Cid, 3 ("j A| W) has the same outer bound 
as Ciu(n, A| W). An important key result in the case of the 
average error criterion is given in the following proposition. 

Proposition 2: Fix r > arbitrarily. For any (n,Ni, N2, 
fi n , A„) code with p, n + A„ < 1 if the rate r ijn = i log log N if 
i = 1,2 satisfy 



n, n > Ri + t 

r 2 ,n > R2 + T 



log n 1 



n 
logn 



- log log W, 

n 

-loglogUf, 



(10) 
(11) 



then, for any 7 > 0, the sum fi n + X n of two average error 
probabilities satisfies the following: 

l-/2 n -A„< Sl nn {R x ,R 2 \W n ) 

+i/„ )T (i2 1> i2 2 ,|^|,|y|), 

where 

v niT (R u Ra,\X\,\y\) 
A | <Y |-2r ! (e" T -i)e" fi i |-y|-2n(e"--i)e" H = 
+ | A ,|-2r l (e"--i)e™ R i . |-y|-2n(e" T -i)e"«2^ 

Since e ,lT — 1 > nr, we have 



-2ri 2 re" H2 



-2n 2 re' l - K2 



< i/„, T (i2i,i?a, |AT|, 

< \x\~ 2n2 ^ nRl + \y\- 
+\x\- 2n2 ^ nRl ■ \y\ 
<3\x\- 2n2TenRl ■ \y\~ 2n2Te " R2 . 

which implies that for each fixed r > 0, u n . T (Ri, R2, \X\, 
\y\) decays double exponentially as n tends to infinity. 

From this proposition, we obtain the following corollary. 

Corollary 2: For any sequence of ID codes {(n, Nx„ N%, 
Pn, A„) satisfying p, n + A„ < 1, n = 1, 2, • ■ -, if 

lim inf r^.n > Ri, i = 1,2, 



then, for any (5 > 0, there exists no = no(5) such that for 

n > no, 

I -Pn- A„ < n n , 7 (Ri -S,R 2 - S\W n ) 

+v n ,r{Ri-8,Ih-6,\X\,\y\). (12) 

It immediately follows from Theorem A, Corollary |2] and 
Property 12 part b) that the following strong converse theorem 
holds. 

Theorem 2: For any sequence of ID codes {(n, Ni, N 2 , fi n , 
A«) satisfying p, n + A„ < 1, n = 1, 2, ■ ■ •, if 



liminfr^ >Ri,i= 1,2, i? 2 ) g C (W) 



then, 



lim inf {u„ + A„} = 1, 



which implies that for any ">0,A>0, fi + X < 1 and any 
noisy channel W, 

C(W) C C ID (/i, A|W) C C, D , a (u, A|W) C C'(W) . 
In particular, if 

C{W) =C{W) =C'(W), 

then, for any /i > 0, A > 0, /i + A < 1, 

C(W) = C m (n, X\W) = C ro , a (M, A| W) = C(W) = c\w). 

Furthermore, fi n + X n converges to one as m 00 at rates 
above the ID capacity. This implies that the strong converse 
property holds with respect to the sum of two types of error 
probabilities. 

IV. Proof of Results 

In this section we shall give the proofs of the results stated 
in the previous section. 

For the proofs of Propositions Q] and we first formulate 
a new resolvability problem for the general MAC, that is, 
an approximation problem of output random variables via 
MACs. We consider this problem and derive an upper bound 
of the approximation error. This upper bound is useful for 
analyzing the error probability of identification outside the ID 
capacity region. Next, we prove Propositions Q] and [2] based 
on a new method of converting the direct coding theorem 
for the MAC resolvability problem into the converse coding 
theorem of the ID via MACs. Han and Verdu (4) provided a 
method of converting the direct coding theorem for the channel 
resolvability problem into the converse coding theorem of the 
ID channel. Our method is an extension of their method in the 
case of MACs. 

A. MAC Resolvability Problem 

Definition 7: Let J/^/^i = 1,2 be the uniform random 
variables taking values in Um 1 = {1,2, M,}. By two 
maps ipi : Umi ^ X n and (p 2 ■ Um 2 ~ * iV™, the uniform ran- 
dom variables Um-l an d Um 2 is transformed into the random 
variable X n = <^i(J7j\/i) an d Y n = if 2 (UM 2 ), respectively. 
Let V Ml {X n ) and Tm 2 (y n ) be sets of all probability 



distributions on X n that can be created by the transformation 
of U Ml and U Ah - Elements of T Ml (X n ) and V M ^ n ), re- 
spectively are called M\ and Af2-types. Every random variable 
X n — ifi( Um 1 ) created by some transformation map (p\ : 
Um„ — > X n and Um 1 has Mi -type. Similarly, every random 
variable Y" = (p^i Um 2 ) created by some transformation 
map (p 2 : Um 2 ~> J 7 ™ and U m 2 has M 2 -type. 

Definition 8: For (pi : Um x — > X n and (p 2 '■ Um 2 — * iV"> 
define P x „ = P^(u Ml ) and p y™ = P v 2 {u M2 )- We use 
and Py n as approximations of X n and Y n , respectively. Let 
be a response of (P^ n ,Pyn) and let be a response 
of (Px»,Py n ). Let Q( 3 > be a response of (P xn ,Py n ). Set 

Q = (Q (1) ,Q (2) ,Q (3) ). 

Let Q (t) , t = 1,2, 3, be sets of all responses QW. 

The following is a lemma on the cardinalities of Vm x ( X n ), 
Vm 2 ( y n ) and fiW, t = 1,2,3. 

Lemma 1: 

a) 

< |Afr M Mp M2 (^ n )| < \y\ nM \ 

b) 

|Q (1) | < 1^(01, |Q (2) | < \v M2 (y n )\, 

|Q (3) | < 1^(^)11^(^)1. 

Now we use Q as an approximation of Q. In this case we 
are interested in the asymptotic behavior of the following triple 
of approximation errors 

(d(Q,Q (1) ),d(Q,g (2) ),d(Q,g (3) )) 

measured by the variational distance. We shall derive explicit 
upper bounds of d(Q,Q^'),t = 1,2,3. This result is a 
mathematical core of the converse coding theorem for the ID 
via MACs. 

Lemma 2: Set M t = \e nRt ], t = 1,2, where \a] is the 
minimum integer not below a. Let Si, i = 1, 2, 3 be arbitrary 
prescribed subsets of X n xy n xZ n . Let (X n ,Y n ) be a pair 
of two independent random variables with distribution (Px n , 
Fy»). Let Q be a response of (Px n , Py n )- Then, for any 
(Px n i Py") and its response Q, there exist Cp\ : Um x — > X n 
and (f>2 ■ Um 2 y n sucn that the three variational distances 
d(Q, Q m ), t = 1, 2, 3 satisfies the following: 

d(Q,Q m ) 

<4E [l S o(X n ,Y n ,Z n )] +3y^J7 t , fort = 1,2, 3. 
The proof of the above lemma is given in the appendix. 

B. Proofs of Propositions and Corollaries 

In this subsection we prove Propositions [T] and [2] and 
Corollaries [T] and [2] stated in the previous section. We first 
prove Propositions [1] and [2] using Lemmas [1] and [2] Next we 
prove Corollaries [T] and [2] respectively, using Propositions Q] 
and |2] 

Proof of Proposition Wi Let P x »\i G G A/i and 

Pyn b G V(y n ),j G J\f 2 , be codewords of (n, N 1 ,N 2 ,p„,X n ) 



code of the ID channel and Dy C Z n , i G A/i., j G A/2 
be decoding regions corresponding to the codewords. Let the 
response P x ^\iPy n \iW n of (iV"|t) ^V ,l |j) be denoted by 
Qjj. We choose Si — Tj l7 , i = 1,2,3. Then, by Lemma [2] 
there exists Q such that 

d{Q l0 ,Q (t) ) <v n ,t(Px»,PY~),t= 1,2,3, (13) 
where we put 

r?n,t(Pxn,Prn) = n n ,t,> r (Rt,Px«,PY»\W n ),t = 1,2, 

»K3(-Pjf»,^v») = a^^i,^,^",^-!^™). 

For simplicity of notation we set ry„ = £7 n j7 (i?i, i?2|W r ™)- 
Then by the definition of f2 ni7 (i?i, i?2|W /n ), we have 

T) n = sup min {n n ,t{Px« , Py^)} . (14) 

ev(x n )xv(y n ) 

From ( fT3l and (Tf4l i. it follows that for any Qij, there exists 
t G {1,2,3} and Q(*) G Q (t) such that d{Q lj ,Q^) < rj n . 
Define 

£ (() ={(y)eMx^ 2 : 

d{Qi h Q {t) ) < Vn for some G Q (t) }. 

Since 

U £< 2 ) U = A/i x A4 , 

we have 

|>C (t) | > ^1^2 for some < G {1,2,3}. (15) 

Set a t = |fi (t) |, i = 1,2,3. Note that M t < 2e ni S i = 1,2. 
Then by Lemma [1] we have 

ai < |A-| 2e " Rl ,a 2 < |^| 2e " R2 ,a 3 < |*| 2 e " Rl • ^l 26 "" 2 . 

Set 

= \xr nR \b 2 ± \yr nR \b* = \x\ 2&nRl ■ \y\ 2&nR2 . 

Now, we suppose that the inequality ( fTBT ) holds for t = 1, Set 

£«(j)^{i:(i,i)G£«}. 

Then, we have 

l4|20')l > 5^1 for some J- 

Then if 

iiV 1 >3 2e " Rl - 1 .6 1 >3fe 1 >a 1 = |Q( 1 )| 
or equivalent to 

ri.n >i?i + ^ + iloglog(3|A-|) 2 , 
n n 

there exist two pairs and (k,j), i ^ k and Q^ 1 -* G Q^ 1 - 1 
such that 

rf(g lJ ,Q (1) )<^,d(Q^,g (1) )<^. 



For the above two pairs, we have 

d{Qij,Qki) < d(Q«,Q (1) ) + i(Qfci,Q (1) ) < 2r?„. (16) 
On the other hand, we have 

<h(l,.Q,,: > 2 [Qij(D itj ) - Q k j(Dij)] 
>2(l- / u„-A„) , 

which together with ( fTol l yields that 1 — /i„ — A n < ry„ . Next, 
we suppose that the inequality ( TT3T > holds for t = 2. By an 
argument quite similar to the previous one, we can prove that 
if 

l7V 2 >3 2e " fl2 - 1 -6 2 >3fo 2 >a 2 = |Q( 2 )| 
or equivalent to 

T2.n > J R 2 + ^ + -l0gl0g(3|y|) 2 , 

ft n 

we have 1 — /i„ — A„ < ?^„. Finally, we suppose that the 
inequality $15[ holds for t = 3. Since 

iiViiV 2 > 3 2(e" i?1 +e"^ ) _ 1 _ 6i&2 ^ 36 ^ 2 > ^ |^ (3) | 

there exist two pairs and (fc, /), 7^ (fc, 2) and Q^ 3 ' 
g Q (3) such that 

d(0«,0 (3) )<»?»,d(Qfci,0 C3) )<^. 

For the above two pairs, we have 

d{Qij,Qu) < d(<9ii,Q (3) ) + d(Qki,Q (3) ) < 2r, n . (17) 
On the other hand, we have 

diQi^Qki) > 2 [ftjfAj) - Qki{Di,j)} 
>2(l-/i„-A„) , 

which together with (ITTb yields that 1 — fj, n — X n < ?]„ . This 
completes the proof of Proposition [TJ ■ 

Proof of Proposition^ Let P xn \ { g V(X n ),i g A/i, and 
Py»|j g P(;y™),j e AA 2 ,be codewords of (n,N 1 ,N 2 ,fi„,Xn) 
code of the ID channel and L> ? j C Z n , i g A/i, j g A/2 
be decoding regions corresponding to the codewords. Let the 
response Px^\%Py^\iW n of (Px"\i, Py^\j) be denoted by 
Qij. For QW g QW, f = 1,2,3, define 

S t (Q (t) ) = {(», j) g A/i x A/" 2 : d(Q ij: Q^) < ? ?n } ■ 
For i = 1,2,3, set 

S< f) '{Q (f) eS (t) : |5 t (QW)| >l}. 
Then, the validity of Lemma [2] implies that 

£ (t) = (J S t(Q W ) fort = 1,2, 3, 

3 

(J |J <S t (Q (t) ) = A/i x A/2. 



Define 



= {<2« e Q (1) consists of pairs 

such that for fixed j we have 

only one index ij, 

Q { 2 ] = {<9 (1) 6 :5i(Q (1) ) consists of pairs 

such that for fixed j we have 

more than two indexes ij, 

Qi 2) = {<9 (2) € Q (2) :S 2 (Q (2) ) consists of pairs 

such that for fixed i we have 

only one index j j , 

Q 2 2) = {g (2) e Q (2) :S 2 (<3 (2) ) consists of pairs 

such that for fixed i we have 

more than two indexes j\, 

Q[ 3) = |<3 (3) e Q (3) :S 3 (<2 (3) ) consists of pairs 

with one index pair (i, j) j, 

consists of more 
than two index pairs (i, j) j. 



Q 2 3) = 



It is obvious that 

fifu^^fiS' 1 , 4 = 1,2,3. 

Observe that if QW g Q 2 1} , for any g Si(Q), there 

exists an index k 7^ i such that (fc, j) g <Si(Q). Then, we 
have 



1 - Mr 



A,, 



< [Qy(Aj) - Qkj(D kJ )] < (l/2)d(Q ij -,Q fcj -) 



< (1/2) d(Q«,Q (1) ) + d(Q fcj ,Q (1) ) 



<??«. (18) 



Similarly, if Q( 2 ) g Q 2 2) , for any g S 2 (Q {2) ), there 

exists an index / =/= j such that g 5 2 (Q^ 2 '). Then, we 
have 



(19) 



If Q (3:i g Q 2 , for an Y (*> i) e <S 3 (<9 (3 )), there exists an index 
^ (k,l) such that (k,l) € 5 3 (Q (3) ). Then, we have 

1 - fi n ,ij - < *7™- (20) 
We obtain the following chain of inequalities: 



1 — P-n — A„ 

^ ^ (1 pn.ij A n .ij") 

t=i (ij)e£<*) 
3 



N ± N 2 



iV!^ 2 



* =1 qWgq« (i,j)eSt(QW) 



1 3 

^E E E 

4=1 gwegf (i,i)es t (QW) 



VE E E (i-^ 



AW: 



2 I /=>(*) 



^n,ij ) 



QWeQ'" (»,j)e5 t (QW) 



< 



E 



(3) 



ATy 



TViTV; 



+ ?7n 



. l^A/ 3 (y n )i 
\VMAx n WM 2 {y n )\ 

N X N 2 

2«e" Rl |-y|2ne nH2 

~Ni + ~N~2 

\x\^ nRl \y\™" R2 



(b) \X\ 



+ Vn 



Vn 



(21) 



Step (a) follows from (fl~8T > -(f20b. Step (b) follows from Lemma 

□ and M t < 2e nR *,t= 1,2. Then, if Ni > \X\ 2nen{Rl+T) and 
i 2 „e"< R 2+T) 



iV 2 > |^| 

ri,„ > i?i + r 

Tl,n > B.2 + T 

from (f2TT >. we have 

1 — Mn — A n 



or equivalent to 

loen 1 



n n 
logn 1 



Ioglog|#| s 
loglog|3f 



< 



I3>| 



2ne™ R 2 



\X\ 



2ne™( R i+ T > 



|j;|2ne™< H 2+ T ' 

|A-| 2 " e " Rl |y| 2 " e " R2 

|2ne"<- R i+ T ) n;|2rie™(- R -2 + -) + 



\x\^ n ' Hi+r) \y\2 

= v n , T {R u R 2 , \X\, \y\) + n„, 7 (#i, R 2) W n ) . 

This completes the proof of Proposition [2] ■ 
Proof of Corollary Q} We assume that a sequence of ID 
codes {(n,Ni,N 2 , /j„, A„) }%> =1 satisfies /j n + A„< l,n = 
and 



1,2, 



Since 



lim inf — log log N > R%, i = 1, 2. 

n— ^oo 7} 



(22) 



lim 

n— >oo 

lim 

n— voo 



logn 1 . . ,_, vn 2 

+ - log log (3\X\) 

n n 

^ + -iogio g (3|3;|) 2 

n n 



0. 



there exists m — ni(6, \X\, \y\) such that for any n > n\ 

^ + Iloglog(3 W ) 2 <|, 
n n 2 

^ + iiogiog(3|3;|) 2 <|. 

n n 2 



On the other hand, by virtue of (l22l . there exists n 2 = n 2 (S) 
such that for any n > n 2 

1 (5 

-log log A^ >Ri- -,i = 1,2. 

n 2 

Set 77 = n (<5, = maxjni, n 2 }. Then, for any n > n , 
we have 

- log log A^ > R 1 - S + ^ + - log log (3|*|) 2 , 
n n n 

-loglogAr 2 > i? 2 -^+^ + iloglog(3|y|) 2 . 
n n n 

Applying Proposition Q] with respect to Ri — S,i = 1,2, for 
n > no, we have (0 of Corollary [TJ ■ 
Proof of Corollary [J} We assume that a sequence of ID 
codes {(n,Ni,N 2 , p, n , A„) }£L X satisfies /2„ + A„ < l,n = 
1, 2, ■ • • , and 



lim inf — log log N > iij, i = 1, 2. 

n— »oo 7i 



(23) 



We choose r = (1/3)5. Since 



lim 

n— >oo 

lim 

n— >-oo 



log n 1 



-log log |^ 

/t 77 

logn 1 iiogiog|y|= 



o, 

= 0, 



n n 

there exists m = ni(<$, such that for any n > n\ 

log n 1 , . , , . 9 <5 
r+ -^ + -loglog Af 2 < -, 
n 77 2 

logn 1 , , . . 9 S 
r + ^ + -loglog|y| 2 < -. 
77 n 2 



On the other hand, by virtue of (l23l . there exists 772 = n 2 (S) 
such that for any n > n 2 

1 (5 

-log log TV, >Ri- -,i= 1,2. 

77 2 

Set 77,0 = no(<5, \X\) — maxjni, n 2 } . Then, for any 77 > no, 
we have 

-loglogjVi > ^ - 5 + t + -\og\og\X\ 2 , 

n 77 n 

- log log JV 2 > R 2 - 5 + t + + - log log \y | 2 . 

n n n 

Applying Proposition [T] with respect to Ri — 5,i = 1,2, for 
77 > no, we have ( flZb of Corollary [2] ■ 



Appendix 

A. Proof of Property \2\ 

Proof of Property \2\ part b): We assume that (Ri,R 2 ) ^ 
C (W). Then there exists small positive number 70 such that 
for any < 7 < 70, we have 

{R 1 - 1 ,R 2 - 1 )£C'(W). 



Then, by the definition of C (W), for any (X, Y) G S n we 
have 

(R 1 -j,R 2 -j)<£C'(X,Y\W), 

or equivalent to 

R 1 - 1 >1{X:Z\Y), (24) 

or R 2 - 1 >7(Y;Z\X), (25) 

Pi — 7 > 7(X; Z), i? 2 - 7 > I(Y; Z) 
R 1 +R 2 -2 1 > I(XY:Z). 

We first assume that d24l i holds. Then by the definition of 
I(X;Z\Y), for any 7 G [0,7b), 



or 



(26) 



lbociM^\jR 1 ,P xn ,P Yn \W n )=0. 



(27) 



We choose t so that r = (1/2) ( 7 + 70). Then by Property [TJ 
part a), we have 

n^ tn (R u p xn ,p Yn \w n ) 



< e" 



n^ t JR u P x ^P Y ,\W n ) 



-n ( n %(R u p xn} p Yn \w n ). 

From d27l i and (l28l i. for any 7 G [0, 70), 



(28) 



lmnrfn n ,i, 7 (iii,Px»,iV»|W rn ) = 0. (29) 

n— >oo 

Next, we suppose that d25l l holds. In a manner quite similar 
to the case of (l24l >. we obtain 

limMn nt2 ^(R 2 ,P X n,Pyn\W n ) = 0. (30) 

71— >00 



Finally, we assume that (l26t holds. Observe that 

n$„(iii,ik,p JC »,iv»|w n ) 



<Pr i?i- 7 < -i A -»z»(^ n ;Z n ) 
I n 

+PiiR 2 - 1 <-i Y n Zn (Y n ;Z n ) 



+Pr jPj + P 2 - 2 7 < -i x » K n Z n (X n r n ; Z") j . (31) 

By (HQ, (EB, and the definitions of T(X; Z), 7(1"; Z), and 
7(XY"; Z), for any 7 G [0,70), we have 

lim fl^l JR U R 2 ,P X „ , Py„ \W n ) = 0. (32) 

n— >oo ' ' ' 

We choose r so that t = (l/2)( 7 + 70). By Property [TJ part 
a), we have 

n^ 3n (R u R 2 ,p xn ,p Yn \w n ) 

< 3e-" T + n^l T (R lt R 2 , P X n, Pyn\W n ) 

-n% tl {R u R 2l p xn ,p Yn \w n ). 

From ( 1321 and d33l l. for any 7 G [0, 70), we have 



(33) 



lim n nt3>7 (R 1 ,R 2 ,P X n,P x „\W n )=0. (34) 
n—toQ 

From (O, (T30ll, and (l34l . we have 

lim n n , 7 (Pi,P 2 ,P x „,Py»|W r ") = 



for any 7 G [0,70) and for any (X, V) G Si. Hence, by the 
definition of f2 n]7 (i?i, R 2 \W n ) we have for any 7 G [0,70), 

lim tt n JRi,R 2 \W n ) = 0, (35) 
completing the proof. ■ 

B. Proof of Lemma [2] 

In this appendix we shall prove Lemma [2] We first define 
several quantities necessary for the proof. 

Definition 9 (Partial responsefSteinberg Let (X n , Y n ) 
be a pair of two independent random vectors with distribution 
(P X n, P Y n). Let S be a subset of X n x y n x Z n . Define a 
measure on Z n by 

Qs(z)= W n (z\x,y)P Xn (x)P Yn (y) 



E 

xl s (x,y,z) 



(36) 



We call the measure Qs the partial response of (P X n, Pyn) 
on S through noisy channel W n . By definition of the partial 
response, it is obvious that 



}s + Qs< 



(37) 



Note that Qs is no longer a probability measure. 

Let Si,i = 1,2,3 be arbitrary subsets of X n x y n x Z n . 
For i = l,2,3 define 

Si,z = {z£ Z n : (x, y, z) G Si for some x, y} , 
Si.zy = {(z, y) G Z n x y n : (x, y, z) G Si 
for some x } . 

For z G Si z define 

Si, X y\z(z) = {(x,y) G X n x y n : (x,y,z) G S t } , 
Si,y\z(z) = {yey n :(z,y)eS it zY}. 
For (z,y) G S^zY define 

Si, x \zY{z,y) = {x G X" : (x,y,z) G 5J . 

Proof of Lemma [2} The proof consists of three steps. 

Sfe/? 7 (Random Coding Argument): Let X™,j G Z/a/j be 
a sequence of independently and identically distributed (i.i.d.) 
random variables each with distribution P X n G V(X n ). Each 
output of the above random variables define a map (p\ : Um 1 
—> X n . We use this randomly selected ^1 asa transformation 
map. Define 

, A f 1 if x = x' 
X '^ = \o else 

Using the above (pi, the input distribution P X n = {P X n(x) 
}x£X n of <^i({/mi) becomes a random variable, having the 
form 



P X n(x) = P [X n X r, 



](*) 



Mi 



Similarly, let G Um 2 be a sequence of i.i.d. random 

variables each with distribution Pyn G V(y n ). Each output 



of the above random variables define a map tp 2 ■ Um 2 ~ * y n ■ 
We use this randomly selected as a transformation map. 
Using the above if 2, the input distribution Pyn = {Pyn(y) 
}yey n of (P2{Um 2 ) becomes a random variable, having the 
form 



M-2 



Py n {y) =P [ r«,r«..,r» 2 ](y) = ^ExvQ? 
Note that 



E 



E 



E 



E 



?si[xr,jcy 1 ...,jr» ](*) 



E 



i(2) 



s 2 [y 1 -,y 2 '\-,y J ;y 
Qs 2 (y), 



E 



(38) 



(39) 



(40) 



5fe/7 2 (Estimation of the Variational Distance): On the 
upper bound of e?(<3, Q^sJ, we obtain the following chain 
of inequalities: 

d{Q,Q (t) ) 
= J2 \Q (i) (z)-Q(z)\ 



= E \Q%(z) + Q<£l(z)-Q Si (z)-Qst(z)\ 

zez™ 

< E {\Qs}(*)-Qs t (z)\+Qg,(z) + Qs S (z)} 
= E \Qs!(*)-Qs<(z)\+ E <3sf(«) (4D 
+E[i S c(x",y",z")] . 

Next we evaluate the first and second terms in the right 
member of d4Tb . For i = 1,2,3, set 



h-i = E ef(4^= E l<5g(*) 

zeSf _ zeSi.z 



We first observe that 

E[Aj] = E [l S c(X",r",Z")] , i = 1,2,3. (42) 

Next we derive upper bounds of i = 1, 2, 3. We first derive 
an upper bound of $1. Observe that 

$1 

< E^-(2>) 



yes 1: y 

x E \Pz^, s S z \y)-P z ^, s Mv)\ 



Applying the Cauchy-Schwartz inequality and using the con- 
cavity of -y/x, we have 



$1 

< E p Y<y) x {Pz^{Si,z\y{v)\v)} 
yeSi,Y 



1/2 



E 



2 \ 



*£Si,z|y(I/) 

< E p y^y) 



P Z n {Y n(z\y) 



1/2 



E 



{p« |y „ iSi (z|y)-P z »|y» Sl (z|y)} 



2 \ 1/2 



<{Py-(^i,y)} 1/2 

E P ^(y) 



E 



(i) 

z™|y>\Si 



(^|y)-P z „| y „ )Sl ( Z |y)}' 



1/2 



< < 



E p ^(y) 

(z,y)eSi lZ v 



Pz-iy»(*|v) 



{P^ Si (z\y)-P ZnlY ^ Sl (z\y)y 

P Z n\ Y *(z\y) 



1/2 



(43) 



Taking expectation of both sides of d43l l and using Jensen's 
inequality, we have 



E[$J 

<| E p y-(y> 

I (z,y)eSi, Z r 



Var 



1/2 



(%) 



In a manner quite similar to the above argument we obtain 
E[$ 2 ] 



<<j £ P X n( X )- 

(z,x)GS 2 ,zx 



Var 



3(2) 
z\x,s 2 



(z\x) 



1/2 



Pz"|X"(2|a;) 



Next, we derive an upper bound of $3. Applying the Cauchy- 
Schwartz inequality, we have 



1/2 



$ 3 < { E 



x < 



E 

z£S 3<: 



{Q { £(z)-Q Ss (z)} 



2 \ 1/2 



E 



{ggW-Q^W} 



2 \ 1/2 



(44) 



Taking expectation of both sides of (l44l and using Jensen's 
inequality, we have 



Ef$,l < 



E 



Var 



)(3) 
! S 3 



1/2 



Q(*) 



(45) 



Step 3( Computation of the Variances) : Observe that 

2 



= m^E E [w^(*|x >v )] a Xas (A-;) 

+m2 E E E 

,X\ZY 

(z,y) x'eSy tX \ZY{z,y) 

xW n (z\x,y)W n (z\x',y) Xx (X> l ) Xx ,(X?,)(46) 
Taking expectation of both sides of d46l i. we obtain 



E 



<^ E [W n (z\x,y)] 2 P Xn (x) 



aseSi,x|zYO*.l/) 



+ { j Pz"|y",s 1 (^|y)} 2 - 
Thus, we have 



Var 

1 



!BGSri,x|aY',- r (*,y) 
From the above inequality and (144-b . we obtain 

E[$i] 



< 



V- W ( Z |y) | 

cxp{-7i [Ri - ±i X "-Y"-Z"(x;z\y)] } 

(x,y,z)£Si 

xW n (z\x,y)P Xn (x)P Yn (y) 



1/2 



1/2 



>Cn,iM R i> p x«,Pr»\W n ). (47) 
In a manner quite similar to the above argument we obtain 

(48) 



E[$ 2 ] < JCn,2,s a (R2,Px»,Pr»\W* 



~ (1) 

Next, we compute Var[Q^ (z)\. Observe that 



Mi M 2 



m 2 m? EE E 

1 2 3 - =1 fc=1 (x,y)£S 3tXY \z{z) 

x[W n (y\x,y)] 2 X x(Xf)xy(Y k n ) 



+ 



1 



M 2 



EE E 



i ^ j=£f k=l (x,y)eS 3tXY \z(z) 
(x\y)<ES 3 _ XY \z(z) 

xW n (z\x,y)W n (z\x',y)x x (X?) Xx ,(X?,) Xy (Y k n ) 

Ah 

+ m 2 m 2 EE E 

1 2 j = 1 k ^ k , (x,y)£S 3 ^xY\z(z) 
(x,y')£S 3: xY\z{z) 

xW n (z\x,y)W n (z\x,y')xx(X^ Xy (Y k n )Xy'(Y^ 

+ M 2 M 2 EE E 

A j+3' k^k' (x,y)£S 3t xY\z{z) 
(x' .y')eS 3 ,xYiz(z) 

xW n (z\x,y)W n (z\x',y') 

x Xx {X^)xA^)Xy{y^)Xy'{Y§). (49) 
Taking expectation of both sides of ( |49l , we obtain 

2" 



E 



< 



i 



J2 [W n {z\x,y)\ 2 P Xn {x)P Yn (i 

(x,y)£S 3: xY\z{z) 

+ w 2 E E 

y£S 3:Y \z(z) x,x'eS 3iX \Yz(z,y) 
x W n (z\x, y)W n (z\x', y)P x „ {x)P X n {x')P Y « (y) 

+mt E E 

x£S 3 ,x\z{z) y,y'eS 3>Yl zx(z,x) 
xW n (z\x,y)W n (z\x,y')P x ,(x)P Yn (y)P Yn (y') 
+ {Qs 3 (z)} 2 . 

Thus, we have 



M\M-x 



Var 



< 



1 



MiM 2 



(x,y)eS 3 ^xY\z(z) 

+Jf 2 E [^"(^|y)] 2 Py n (y) 

3/es 3:V | Z (z) 

±r J2 [W n (z\x)] 2 P Xn ( X ) 



Mi 

a=eS , 3 . X | Z (z) 

From the above inequality and (PES! , we obtain 
E[* 3 ] 



< 



E E 

zeS 3 ,z (x,y)£S 3tXY \z(z) 



[W n (z\x,y)} 2 P Xn (x)P Yn (y) 
M 1 M 2 Q(z) 



E E 

zes 3 ,z yeS 3 ,y|z(z) 

E E 

z£S 3 .z aseS 3( x|z(*) 



[W n (z\y)f P Yn (y) 



M 2 Q(z) 



[W n {z\xf P xn {x) 



1/2 



MiQ(«) 



Y exp{-n [i?i +i? 2 - ^x»y«z»(a;j/;2)] } 

(a;,y,z)GS 3 

xW^(«|xv)Pjc»(»)JV»(») 
+ CX P { _n [^2 - ^iyv-zn (y; z)] } 

(y,z)eS 2 ,i-z 

xW n (z\y)P Y n(y) 
+ Y cxp{-n - ii x . z .(a;;2)] } 

(a;,z)6Si,xz 

1/2 

xW n (z|a;)iV.(a:) 



Cn,3,s,(fli,i2a,i > x»,iV»|W») 



(50) 



Set 



9. t = E [l S a (X n , Y n , Z n )] + v^A, i = 1, 2, 3. 
From (g2]i, d47t . (l48b . and <[50j, we obtain 

E ^ eri(A i + ^) 

i=l,2,3 

= J2 Qr^EtAi] +E[#i]} 

i=l,2,3 

< ^ er 1 {E[l S c(X»,y™,Z")]+ A /^:}=3. 

i=l,2,3 

Then, there exists at least one deterministic maps = 1,2 
such that 

Y ar 1 (A i + $ 4 ) < 3 , 

i=l,2,3 



from which we have 

Ai + $i < 3e ij i = l J 2, 3. 
From fiTT i and ((5TJ, we obtain 

d(Q,Q«) 



(51) 



<4E[l S c(X",y",Z")] +3VC^, i = 1,2,3, 
completing the proof of Lemma [2]. ■ 
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